Instability of square vortex lattice in d-wave superconductors is due to paramagnetic 

depairing 
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Effects of the paramagnetic depairing on structural transitions between vortex lattices of a quasi 
two dimensional d-wave superconductor are examined. It is found that, in systems with Maki 
parameter «m of order unity, a square lattice induced by a d-wave pairing is destabilized with 
increasing fields, and that a reentrant rhombic lattice occurs in higher fields. Further, a weak Fermi 
surface anisotropy competitive with the pairing symmetry induces another structural transition near 
H C 2- These results are consistent with the structure changes of the vortex lattice in CeCoIns in 
H || c determined from recent neutron scattering data. 

PACS numbers: 



Recently, various novel superconducting (SC) proper- 
ties have been found in the heavy fermion superconductor 
CeCoIns in magnetic fields. Among them, the discontin- 
uous £zc2-transition [l| and a new high field phase, iden- 
tified with a Fulde-Ferrell-Larkin-Ovchinnikov (FFLO) 
vortex state 0, H, [3, Q, have been the subjects of cen- 
tral interest in the research field. Quite recently, much 
attention has been paid, in turn, to the vortex lattice 
in fields (H || c) perpendicular to the SC layers. An un- 
usual H dependence of the structural factor of the lattice 
has been noticed and argued [1, 0] to be due to an in- 
terplay of the paramagnetic depairing Q and a non-SC 
(magnetic) critical fluctuation, both of which become ac- 
tive on approaching H C 2(0) from below. Another feature 
stressed there @, 0] is a striking reentry of the region of 
a rhombic lattice which is accompanied by an instability 
of a square lattice induced by a d-wave pairing [9l [lOl 
or a four- fold anisotropy of the Fermi surface (FS) [10l | : 
With increasing H in H > 0.6iJ C 2(0), the square lattice 
changes into a rhombic one. It will be valuable to clarify 
whether the origin of this reentry is due to the paramag- 
netic depairing, the non-SC critical fluctuation, or others 

Below, we study changes of the vortex lattice structure 
induced by the Pauli paramagnetic depairing in a super- 
conductor with a d-wave pairing. In the orbital limit 
with vanishing Maki parameter om = \/2H OI b (0) / Hp (0) , 
the familiar enhancement of square lattice symmetry 
in higher magnetic fields and upon cooling is obtained, 
where if O rb(0) is the orbital limiting field in 2D case, 
and Hp(0) is the Pauli-limiting field. By contrast, our 
calculation using a Maki parameter cvm > 2.5 shows a 
phase diagram similar to the observed one in CeCoIns 
[6|, where a reentry of the rhombic lattice region occurs 
with increasing H , and suggests that effects of the pair- 
ing symmetry on the structure and orientation of the 
vortex lattice are weakened with increasing the field by 
the paramagnetic depairing. In fact, a FS anisotropy 
competitive with the d-wave symmetry is found to, in 
higher fields, can change the orientation of the vortex lat- 
tice discontinuously. The present results strongly suggest 
that the main origin of the square to rhombic reentrant 



structural transition (ST) curve seen in CeCoIns is the 
paramagnetic depairing. In relation to this, the issue of 
the pairing symmetry of CeCoIns will also be discussed. 

The theoretical method we use here is a straightfor- 
ward extension of that in Ref.Q starting from the 2D 
BCS hamiltonian with a circular FS 
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to derive an appropriate Ginzburg-Landau (GL) free en- 
ergy density T , where <p a {r) = S^ 1 ^ 2 J2 P c a(p)e lp ' r , S is 
the system area, and B a {k) = J2 P A p c_ CT (— P ) c a (p + ), 
where p± = p ± k/2. Effects of including a FS 
anisotropy will be explained later. The normalized 
pairing function A p will be assumed hereafter to be 



\/2cos(2</>p), where 



arctan(p J ,/p a; ). In H | c of 



interest in this work, spatial variations parallel to H are, 
in the mean field theory, negligible in the equilibrium 
states in lower fields than the FFLO region [3|, |j| just 
below H C 2 ■ For this reason, we can focus hereafter on 
the 2D model (1) to discuss CeCoIn 5 . 

In deriving T in H || c from the model (1), two mixings 
neglected in Ref.[4j need to be incorporated here: First, 
in expressing the SC order parameter A in terms of the 
Landau level (LL) modes, a coupling or mixing, induced 
by the d-wave symmetry, between the lowest (n = 0) and 
higher (n = 4m > 4) LLs will be incorporated in the GL 
term Ti quadratic in A and A* because we are inter- 
ested here in properties in intermediate magnetic fields 
rather than those close to H C 2 0]. For simplicity, just the 
most dominant contribution among the higher LLs, the 
n = 4 LL, will be kept below. Further, a small mixing, 
which occurs in the higher order GL terms T m (m > 4), 
in the momentum space between the relative momenta 
of Cooper pairs and the reciprocal lattice vectors of A 
will be taken into account. The contribution to the sign 
and magnitude of T m of the latter mixing is quite small 
and, in fact, was neglected in the previous work Q where 
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FIG. 1: One half of a unit cell of a vortex lattice in real space 
oriented (a) by the d I .2_ H 2-pairing function A p or (b) by a 
four- fold FS anisotropy competitive with A p . A rhombic to 
square ST is driven by the squashing indicated by each solid 
arrow. 



the global phase diagram was studied. However, it plays 
essential roles, together with the higher LL corrections, 
in studying stable lattice structures. 

Then, A is expressed as A(r) = clq (po(x, y)+ci4 <pa{x, y) 
satisfying (|A| 2 ) S = 1, where, in the Landau gauge A = 

Hxy, Vn = (n\r 1 / 2 (r H (-id y +2eHx-d x )/V2) n Mx,y), 
Vo{x,y) = CoE„ ex P[i( fcn (^/ r ff) + 7r«- 2 /2) - (kn + 
x/rn) 2 /2] is the Abrikosov lattice solution in the n = 
LL with the orientation of Fig. 1(a), r^ 1 = \/2eH, and 
( } s denotes spatial average. The order parameter of the 
square to rhombic ST is k 2 — it, where k (> 0) is defined 
by k 2 = 7rcot(7/2) in terms of the apex angle 7 (see 
Fig.l(a)). 

The quadratic GL term T% takes the form 

T 2 = A r (0)[A^oo|o | 2 + Al 4 4|a4| 2 + A^ 4(aS a 4 + a\a )], 

(2) 

where 
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I ^|A^£ nin2 ( Mo ) exp(-|/i | 2 /2),(3) 

£nn(p) = L n {\p\ 2 ) is the nth order Laguerre polyno- 
mial, £40 (m) = = M 4 /V24) Mj = Pj( v x ~ 
iv y )/(V2r H ), 
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l/£o is a mean free path in the normal state normal- 
ized by the coherence length , and T cQ is the (mean 
field) SC transition temperature in the case with H = 
and I — 00. Further, any spatial variation of the 
flux density was neglected. After diagonalizing eq.(2), 
the H C 2 (T)-curve is given by MqoMu — (M04) 2 = 
0. The eigenmode determining H C %(T) takes the form 
A = cosx <fio + sinxy>4, where x > 0; anc > c °s2x = 
(M44 ~ M 0Q )/y/{M44 - Moo) 2 + 4A1 2 , 4 . 

Next, let us turn to the analysis of the quartic GL term 
J- 4, or equivalently, the Abrikosov factor 0a determining 
the lattice structure. Hereafter, we use the gauge A = 
Hxy. To express T4 in a convenient form for numerical 



analysis, we use the relation 

A (n) (r;rf = exp(v7v(-iV + 2eA))p n (x,y) 
exp(-H 2 /2)/ . d 
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which can be obtained in the present gauge by extending 
the analysis in Ref.Q to the case with higher LLs. The 
function Lp n {x,y) itself is given by taking the p, p* — * 
limit in eq.(5). Then, T4 is expressed by 0| 
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Ja = S^fd 2 * f ^Re[|A p | 4 A(r)(A(r;-^)r 
x (A(v;-p 3 )r A(v;p 2 )], (7) 

and 

A(r;^-) =cosxA(°)(r;^)+sin X A( 4 )(r;^). (8) 

Below, other higher order GL terms will not be con- 
sidered. This assumption is not permitted if T± < 0. We 
will neglect the narrow region close to H C 2(0) including 
the FFLO region and focus on the field and tem- 

perature range with a positive T4. Then, by carrying out 
the r- integral and the /Zj-derivatives in eq.(6), J4 is given 
by 
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FIG. 2: Square to rhombic ST (thick solid) curves and the 
corresponding H C 2(T) (thin solid curves) in the h-t phase di- 
agram in the case with the Maki parameter and 2.8, the 
circular FS, and the fixed value I — 20£o. Each thick solid 
curve was obtained by neglecting the 0(tan 2 x) term in eq.(9). 
For cim = 0, the square lattice is realized everywhere above 
the ST curve, while it is limited for olm ~ 2.8 in the area sur- 
rounded by the closed ST curve. For olm = 2.8, a crossover 
line on which 7 = 70 degrees and the high H branch of the 
ST curve calculated by including the 0(tan 2 x) contribution 
of eq.(9) are indicated by the dashed curves and the solid cir- 
cles, respectively. The open circles represent the olm = ST 
curve with fluctuation corrections (see the text). 

and 

K 2j -i = H2j-i + + (-1) J >3 + V2k(m - n)]) 

(j = 1,2). As is shown in Fig. 2, even the contribution of 
the 0(tan 2 ^) term is quantitatively negligible, and, for 
this reason, higher order terms in taxix were neglected 
above. The mixing or coupling, occurring through the 
fc-dependent terms in pg and Kj , between the momenta 
p on FS appearing in the gap function A p and the re- 
ciprocal lattice vectors leads to structural changes of the 
vortex lattice at a fixed orientation. By determining the 
k- value minimizing JF4 (> 0) at each (H, T), structural 
changes of the vortex lattice have been examined. 

As examples of calculation results following from 
eq.(9), we focus below on those for a a/ = and 2.8. 
The resulting square to rhombic ST lines for these qm 
values are expressed in Fig. 2 by thick solid curves un- 
der a fixed l/£o, where t = T/T c0 , and h = i?/iJ O rb(0). 
In our calculation, the square to rhombic ST illustrated 
in Fig. 1(a) was of second order everywhere. In higher 
H where the paramagnetic depairing is more important, 
aM-dependence of the ST curve is striking: In the orbital 
limit where olm — 0, the square lattice becomes more 
rigid in higher H, while it is limited, as in Fig. 2, in the 
intermediate field range surrounded by a closed ST curve 
if qjk > 2.5. This reentry of the rhombic lattice implies 
that the interplay between the orbital-depairing and the 
e?-wave pairing symmetry, enhancing the square lattice 
and fixing the orientation of the vortex lattice, is weak- 
ened by the paramagnetic depairing. On the other hand, 
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FIG. 3: ST lines and the corresponding H C 2(T) lines for the 
fixed value om = 2.8 obtained for / = 00 (open circles and 
the upper dashed curve) and I — 14.5£o (thick and thin solid 
curves). When I — 00, the discontinuous i/ C 2-transition 
due to the paramagnetic depairing occurs in t < 0.13, and the 
Pauli-limiting field Hp corresponds to the value h — 0.505. 
Between the first order ST curve (lower dashed line) and 
H C 2(T) in olm = 2.8, the vortex lattice has the orientation 
indicated in Fig. 1(b) [f|. 



although the ST curve in low fields h <C 1, where the 
paramagnetic depairing is ineffective, shows the expected 
behavior insensitive to aM-values, it is not quantitatively 
reliable because our approach assuming dominant roles 
of the lowest LL is valid in higher fields. In fact, the 
square lattice region seems to have been overestimated 
near the low T and low H corner. 

Figure 2 implies that a reentrant and closed ST curve 
similar to that [6| found from neutron scattering data 
of CeCoIns in H || c follows from olm of order unity. 
Judging from such a large effect of a finite olm 1 the para- 
magnetic depairing is expected to be the main origin of 
the reentrant ST curve in CeCoIns [|| . For comparison, 
an olm = ST curve with effects of elastic thermal fluc- 
tuation [ll|, OjJ included is expressed in Fig. 2 by open 
circles. The fluctuation is incorporated in the squash- 
ing elastic modulus following from eq. (9) via replacement 
k 2 — > k 2 (l — 3k 2 u 2 /(Anrjj)) pjj, where u 2 is the mean 
square average of vortex displacement calculated in terms 
of the material parameters of CeCoIns Q . The obtained 
result clearly shows that the fluctuation-induced mecha- 
nism is a minor contribution to the reentry of the rhom- 
bic lattice in CeCoIns. Hereafter, two additional features 
seen in the experimental phase diagram will be discussed. 
First, the high H branch of the ST curve in Ref.0] has 
shown a negative slope even at lower T in contrast to 
the positive slope in Fig. 2. Since the paramagnetic effect 
suppressing the square lattice is more effective at lower 
T, the positive slope in the present calculation is reason- 
able. A possible origin changing the slope sign of the 
high H branch is the quasiparticle damping due to 
the non-SC critical fluctuation. In Fig. 3, we show Z/£q 
dependence of the phase diagram in olm — 2.8 case. In 
the context of CeCoIns, the quasiparticle mean free path 
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I is not due to impurity scatterings but rather should be a 
consequence of non-SC critical fluctuations, ft has been 
argued [f| that this damping effect is not negligible in the 
high H region close to H C 2(0) of CeCoIns in H || c. As 
Fig. 3 shows, effects of a nonvanishing £o/l on the high H 
ST curve are quantitatively weak in agreement with our 
view that a large olm is the main origin of the reentrant 
ST curve. Nevertheless, the high H ST curve tends to ap- 
proach a flat curve with decreasing l/£ : I n the l° w T re- 
gion dominated by the paramagnetic depairing, a quasi- 
particle damping suppressing the paramagnetic effect is 
more effective and slightly shifts the high H branch up- 
wardly, while it shifts this branch downwardly at higher 
T where the orbital depairing is rather important. We 
expect an inclusion of a (unknown) T-dependence of I to 
resolve this issue more satisfactorily. 

The experimental phase diagram Q also includes first 
order STs between the two orientations indicated in 
Fig. 1(a) and (b) both above and below the field region 
of the square lattice. To understand this, we have also 
examined effects of a weak four-fold anisotropy of FS 
competitive, in orientation, with that of A p on the high h 
region of the olm = 2.8 phase diagram by introducing the 
anisotropy, as in Ref.[l(|, through the replacement 
on the Fermi velocity, vp — ► vp(l — /3cos4<jf> p ) — fl 2 
((3 > 0), and the density of states. When this vf- 
anisotropy is more dominant, the vortex lattice begins 
to change with the fixed orientation of Fig. 1 (b) . We find 
that, for a weak FS anisotropy with [3 = 0.05, a first or- 
der ST between the two orientations indicated in Fig.l 
appears on the lower dashed curve in Fig. 3, above which 
the square lattice and a rhombic one with 7 = 74.5 de- 
grees are nearly degenerate in energy with the orienta- 



tion of Fig. 1 (b) . This result fixes our view on the high 
field side of the experimental phase diagram of CeCoIn 5 
6] and supports the picture that the closed and reen- 
trant ST curve is due not to a FS anisotropy but to 
the d x 2_ y 2 -pairing symmetry of CeCoIns. Actually, if 
the in-plane FS anisotropy relevant to the superconduc- 
tivity of CeCoIns is characterized as a single four-fold 
anisotropy, it is quite unreasonable to ascribe both of 
the reentrant ST curve and the first order STs to such 
a single FS anisotropy. Further, bearing the result in 
Ref. [T(| in mind, the fact that another first order ST in 
lower fields, where the finite «m does not work, is lim- 
ited to a narrow range (< 0.5 (T)) Q is consistent with 
the weak FS anisotropy assumed here. We note that the 
states with the orientation of Fig. 1(b) are limited to the 
range h < 0.4 irrespective of the l/t;o value and, when 
I = 00, are not realized near H C 2(T) in contrast to the 
observation This supports the argument || that the 
quasiparticle damping is not negligible in understanding 
the region near H C 2 of CeCoIns. 

In conclusion, the paramagnetic depairing easily de- 
stroys the square vortex lattice stabilized by a d-wave 
pairing and is believed to be the main origin of the reen- 
trant square to rhombic structural transition curve found 
in CeCoIns [gj. The present results indicate that the 
paramagnetic depairing plays unexpectedly crucial roles 
in the high H vortex lattice structure and may be the 
main origin of other field-induced lattice structure tran- 
sitions such as the square to rhombic one in TmN^I^C 
with a four-fold anisotropic Fermi surface [13j. 

We are grateful to H. Adachi, Y. Matsuda, T. 
Shibauchi, and M. R. Eskildsen for useful discussions. 
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